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Airasian, Peter W.; KeJIaghan, Thomas; and Madaus, 
George F. Concepts^! School Effectiveness as 
Derived from Research Strategies: Differences in the 
Findings. 1979 50 pages ED 192 456 

Studies of school effectiveness vary widely in their designs Such 
methodological parameters as level of data aggregation, stratifica- 
tion level, strategy of data analysis, and choice of dependent and 
independent variables differ greatly from study to study The 
methodological choices a researcher makes are important, say the 
authors, because "taken together, they help to defrae the de facto 
conceptual f.amework" of a study Understanding tne conceptual 
framework, in turn, is essential for identifying the "inherent mean- 
ing" of a study and for comparing its results to other studies 

In this paper, the authors critique the 1966 Colemn report and 
other school effectiveness studies, with special attention to the^on- 
ceptual framework underlying each study "Our intent is to show 
how different conceptualizations of school emerge from the use of 
different methodological parameters," they state, "and to show 
further how altering one or more of these parameters can alter 
dramatically inferences made about schooling and school effec 
tiveness " 

The conceptualization underlying the Coleman repo r t is as 
follows The school as a whole, by virtue of its static resources and 
facilities, influences pupils' general cognitive outcomes as 
measured by commercially available standardized tests " Home 
background influences are considered "prior to and independent of 
school influences" in this conceptualization But a later researcher 
reanalyzed the same data using different methods that, in effect, 
altered the latter part of the Coleman report's conceptualization to 
read "The school's influence is not necessarily independent of 
pupils' home background characteristics/' This study found that 35 
percent of the variation in student achievement was due to school 
factors, as opposed to the 10 percent found by Coleman 

The authors go on to show how modifications of other methodo- 
logical parameters can influence both the conceptualization of a 
study and the conclusions drawn from its results 

tin) Austin, Gilbert R. "Exemplary Schools and the 

C~i Search for Effectiveness" Educational Leadership, 

37, 1 (October 1979), pp 10-12, .14 EJ 208 050 

. Until the mid-1960s, educators were certain that they could teach 
children of all backgrounds, given adequate resources Doubts 
began to surface, however, with the publication of the 1966 
Coleman report and other similar studies These studies concluded 



that family background factors —and not variations in school facili- 
ties, curriculum, and staff— were the primary determinants of 
academic achievement 

Other researchers during this period, however, were taking a dif- 
ferent approach to the school effectiveness question They identi- 
fied the exemplary or highly effective schools in a sample andthen 
described the characteristics of these schools 

"The major finding of these studies," states Austin, "is that there 
is no one single factor that accounts for a school being classified as 
exceptional These schools appear to have a critical mass of 
positive factors which, when put together, make the difference " 
Each of the factors associated w»th effectiveness was not found in 
every exceptional school, Austin points out, rather the factors "are 
characteristic of the group as a whole " 

In the exceptional schools, the principal's leadership was 

strong, meaning, for example, that the schools were being run' 
for a purpose rather than running from force of habit Principals 
also participated strongly in the classroom instructional program, 
felt they had control over the functioning of their schools, and held 
v high expectations for both teachers and students 

^All staff had greater experience and more pertinent education " 
Teachers had freedom to choose teaching techniques, were more 
satisfied with opportunities to try new techniques, expected more 
children (o show high achievement and display good citizenship, 
and were rated as warmer and more responsive Students had more 
positive self-Concepts and a greater feeling of controlling their 
own destiny Austin concludes that the individual characteristics 
of principals, teachers, schools, neighborhoods, and home 
influence a pupil s achievement far more than particular instruc 
tional models " \ 

v 

C/T) Averch, HarveysA; Carroll, Stephen J.; Donaldson, 

cy3 Theodore S.; Kiesting, Herbert J.; and Pineus, John. 

How Effective Is Schooling? A Critical Review and 
Synthesis of Research Findings. Santa Monica, Cali- 
fornia. The Rand Corporation, 1971 249 pages. ED 
058 495. 

What is the current state of knowledge regarding the determi- 
nants of educfM^onal effectiveness? To find out, the President's 
Commission on School Finance asked The Rand Corporation to 
critically analyze theiust research literature on this topic The 
result is this comprehens\e report, which, the authors emphasize, is 
not simply a 'classical survey ofresearch listing findings without 
much evaluation of the results." Rather, it is a critical survey that 
analyzes each study according to both its "internal validity" and its 



credibility "in the light of accumulated knowledge " 

The authors organized their analysis according to the five basic 
research approaches utilized by researchers One of these 
approaches concentrates on the "processes" applied to students 
and the interactions between teachers and students Classroom 
studies on process show no consistent effect on student achieve- 
ment of different teaching approaches, class size, or instructional 
methods, the authors state, laboratory studies on process suggest 
the importance of the sequencing and organization of learning 
materials and the complexity of interaction effects between 
students, teachers, and methods 

The authors also analyze the input-output' approach, which 
assumes that a student :> educational outcomes are determined by 
the quantities and qualities of educational resources made avail- 
able by personal, family, and community characteristics, the 
organizational " approach, which assumes that the history and 
societal demands on a school are more important than what is 
acually done in the school, the evaluative'' approach, which 
includes studies of the effects of large-scale interventions in educa- 
tion, such as Title I and Head Start programs, and the experiential 
approach, which is represented by the varied literature on educa- 
tional reform 

The authors conclude that research has not identified a variant 
of the existing system that is consistently related to students 
educational outcomes This does not mean that nothing makes a 
difference, or that nothing works','' the authors emphasize 
Rather, we are saying that research has found nothing that con- 
sistently and unambiguously makes a difference in student 
outcomes " 



Brookover, Wilbur B.; Schwitzer, John H.; Schneider, 
Jeffrey M.; Beady, Charles H.; Flood, Patricia K.; and 
Wisenbaker, Joseph M. "Elementary School Social 
Climate and School Achievement ' American Educa- 
tional Research Journal, 15, 2 (Spring 1978), pp 
301-318 Ej 189 559 



"Seme aspects of school social environment clearly make a dif- , 
ference in the academic achevement of schools " This is the fore- 
most conclusion of a study of ninety-one Michigan elementary ' 
schools conducted by Brookover and his colleagues and reported in ' 
this article 

The authors use the term "school climate" to refer to aspects of 
the school social environment they studied School climate, they 
state, "may be broadly conceived as the norms of the [school] social 
system " Specific school climate variables measured included stu- 
dent "sense of academic futility," student "perception of teacher 
push and teacher norms," teacher "perception of principal's expec- 
tations," and "parent concern and expectations for quality educa- 
tion" as perceived by the principal 

From state and school records, the researchers obtained data on 
socioeconomic status of students' families, .acial composition of 
each school, and achievement scores Questionnaires were then 
administered to students, teachers, and the ,}nnr,pal of each school 
o measure school climate variables 

The authors found large differences between : r hools in student 
achievement "The socio-economic and racid compos.tion of the 
scr jols can explain a significant portion of f his variance," they 
state However, the climate variables can also explain a significant 
portion of the variance In other words, socioeconomic and racial 
variables and the climate variables appear to be generally related 
There are exceptions, however Some low-SES schools "have 
school climates favorable for achievement and some high SES 
schools have school climates that are not highly favorable for 
achievement " Favorable climate rather than high SES or racial 
q imposition is, the authors believe, the necessary condition for high 
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(5* Edmonds, Ronald. "Effective Schools for the Urban 
oD Poor " Educational Leadership, 37, 1 (October 1979), 
pp 15-18,20-24 F| 208 051 

Social scientists and opinionmakers continue *o espouse the 
belief that home and family background factors are the chief 
determinants of student achievement But effective schools do 
exist in urban and poor areas, Edmonds argues, and their success, as 
several research studies show, stems from such school-controlled 
factors as leadership, expectation, atmosphere, and instructional 
emphasis. In this article. Edmonds reviews some of these studies 
and argues for the general thesis "that all children are eminently 
educable and that the behavior of the school is critical in determin- 
ing the quality of that education " 

A 1971 study, for example, identified and characterized four 
mstructionally effective inner-city schools All four schools had 
"strong leadership," had high expectations for all of their students, 
had "an orderly, relatively quiet, and pleasant atmosphere," and 
"strongly emphasized pupil acquisition of reading skills and rein- 
forced that emphasis by carefu! "*nd frequent evaluation of pupil 
progress " 

Another study, conducted in 1976, compared two groups of Cali- 
fornia elementary schools that differed only on measures of student 
achievement In comparison to teachers in the lower-achieving 
schools, teachers in the higher-achieving schools reported signifi- 
cantly greater amounts of principal support, were more task 
oriented in their classroom approach, "exhibited more evidence of 
applying appropriate principles of learning," and were more satis- 
fied with their work 

The most tangible and indispensable characteristics of effective 
schools, Edmonds concludes, are strong administrative 'jadership, 
a "climate of expectation in which no children are permitted to fall 
below minimum but efficacious levels of achievement," an 
emphasis on the acquisition of basic^school skills, flexibility in the 
assignment, of resources to meet fundamental objectives, and a 
school atmosphere that is relatively orderly and quiet 
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/Z? Klitgaard, Robert E., and Hall, George. Are There 

vH) Unusually Effective 'Schools? Santa Monica, Cali- 

fornia The Rand Corporation, 1973 37 pages ED 085 
402 

Beginning with the 1%6 Coleman report, large-scale statistical 
studies have failed to find significant relationships between what 
goes on in schools and student achievement These distressing 
results, say Klitgaard and Hall, are "perhaps the most counter- 
intuitive findings in public policy research in the past decade " 

These authors propose an alternative view of the data on school 
effectiveness, which, instead of considering the average effects of 
school policies, asks whether exceptional or outstanding schools 
really do exist The question, as the^uthors put it, is this "Do some 
schools consistently produce outstanding students even after 
allowance is made for the different initial endowments of their 
students and for chance variation?" As long as the number of such 
schools is not large, they state, the mathematics of previous studies 
allow for such a possibility 

The authors reanalyzed several data bases from studies on Michi- 
gan. New York City, and "Project Talent" schools They controlled 
only for non-school background variables" such as SES and 
implicitly assumed that what was left over represented the inf lu* 
ence of school factors and random variation 

Data from the Project Talent and New York City schools showed 
little evidence oi consistent overachievers The Michigan data, 
however, provided some evidence of unusually effective schools 
For example, ot 21 3 nonrural schools that reported scores for "four 
grade-year-test combinations, 72 were at least one standard devia- 
tion above the* mean all four times," whereas only 13 would be 
expected by chance These 72 schools showed significant differ- 
ences from the average on three school-related factors Classes 
were smaller, more teachers had five or more years of experience, 
and more teachers earned $11,000 or more 
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Lipham, James M. Effecttve Principal, Effective 
School Resion, Virginia National Association of 
Secondary School Principals, 1981 "-35 pages ED 
number not yet assigned 



In the late sixties and early seventies, many stu('«es were con 
ducted that found home and family variables to be much more 
strongly related to student performance than such school-based 
factors as teacher preparation, instructional materials, physical 
plant, or dollars spent Today however, states Lipham, many 
researchers are concentrating on "the examination of specific 
school processes and behaviors associated with student attitude 
and achievement " These researchers are comparing the adminis- 
trative and instructional processes of schools that have similar 
socioeconomic characteristics but wide differences in student 
achievement 

Among the many variables examined in these studies/Lipham 
»ays, the leadership of the principal invariably has emerged as a 
key factor in the success of the school In this excellent publica 
tion, Lipham summarizes a great deal of recent educational 
research and literature that identifies the characteristics of elective 
principals and effective schools 

The recent emphasis on strong leadership for effective schools 
may insinuate to some a return to the great person' approach to 
leadership, says Lipham But studies of effective schools have 
focused not on the great person approach but instead on the 
behavior-of the-leader ^situation ' Successful principals, it has 
been found, use a "situational" leadership style and vary their 
behavior as the situation warrants 

Numerous studies show that the principals of effective schools 
're committed to improving the instructional program, have a 
:rong knowledge of 'lawoom instructional activities, frequently 



participate in these activities, monitor the effective use of class 
time, successfully attempt to improve instructional processes, and 
have positive attitudes toward both teachers and students Thus, 
"the single most important factor in determining the success or 
failure of a school," states Lipham, "i* the ability of the principal to 
lead the staff in planning, implementing and evaluating improve- 
ments" in the school's instructional program 

Several other chapters of this publication focus on the goals, 
values decision-making processes, public relations, and 
organizational relationships of successful schools and principals 

£Q} "On School Effectiveness A Conversation with Peter 

(&) Mortimce " Educational Leadership, 38. 8 (May 

1981 ), pp 642-45 E J number not yet assigned 

"Despite the overwhelming relationships we know exist between 
school attainment and social class, the individual school can be 
effective for students of all social groups " This is the main conclu- 
sion of a five-year longitudinal study of unusually effective London 
high schools entitled Fifteen Thousand Hours, coauthored by 
Michael Rutter, Peter Mortimore, and others 

The "outcomes" of education measured by these researchers 
were attendance, behavior in school, delinquency out of school, 
> and academic achievement The most effective high schools, 
according to these measures, had teachers who showed a positive 
attitude toward learning, were generally more organized, empha- 
sized rewards rather than punishments, made conditions for stu- 
dents as pleasant as possible, and involved students more in the 
management of their own learning 

Mortimore believes, however, that particular, actions and 
methods are less important than the existence in a school of a 
"positive ethos." which he describes as "a positive attitude by 
teachers toward young people and a positive attitude toward 
learning " A positive ethos depends on "leadership— strong, posi- 
tive leadersbip that manages to capture the enthusiasm of the 
teachers without being either too democratic or too autocratic " A 
good ethos or school climate also depends on high expectations for 
teacher and student performance, consistency in the treatment of 
students, and the giving of "realistic feedback" to students 

Changing a school's ethos from- negative to positive, however, "is 
extraordinarily difficult, states Mortimore, because once you set 
up a system evervthing in the school relafes to it Real change 
takes time and constant effort But educators can make their 
schools more effective, Mortimore concludes, though it will be 
hard work and they must expect some setbacks " 

Ravitch, Diane. "The Meaning of the New Coleman 
Report" Phi Delta Kappan, 62, 10 (]une 1981), pp 
718-20 Ej 245 760 

Since the publication of the original "Coleman" report in 1966, 
educators have been told again and again that schools don t make 
a difference" and that family backgiound factors have the pre 
ponderance of influence in determining student outcomes The 
new Coleman repcrt dramatically reverses this pessimistic conclu 
sion, ' states Ravitch, and finds instead that schools do make a 
difference, regardless of the family background of students " 

The r new " Coleman report Ravitch refers to is entitled Public 
and Private Schools" (PPS) and is part of High School and 
Beyond," a major longitudinal study funded by the Department of 
Education Alto^ither, nearly sixty thousand high school students in 
over one thousand schools were surveyed, along with their teachers 
and principals 

-> PPS, Ravitch cautions, should be viewed from two distinct view- 
points, one political, the other educational Even before the report 
was available, critics who were fearful that the study would 
promote tuition tax credits or educational vouchers' denounced 
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Coleman s methodolc^v and even bis personal integrity in their 
efforts to discredit his finding that private high schools are, on the 
whole, better than public high schools But there is surprisingly 
good news in the report, too, if educators would pause to listen, 
states Rayitch 

Time and again. Ravitch states, the new report demon sirates 
that achievement follows from specific school polices, not from 
the particular fam ly background of the 1 students Private high 
schools produce better results, according to PPS, not because they 
are private but because they create higher rates of engagement in 
academic activities, have better attendance, and have students 
who do more homework and take more rigorous subjects These 
findings, Ravitch concludes, contain clear implications for the 
improvement of both public and private schools and should be a 
source of rejoicing for educators in public and private schools alike, 
*or they confirm the importance and efficacy of their actions " 



Scott, Ralph, anc 1 Walberg, Herbert J. "Schools Alone 
Are Insufficient A Response to Edmonds " Educa- 
tional. Leadership, 37, 1 (October 1979), pp 24-27 tj 
208 052 

Recent research has identified three sets of factors that are 
strongly and consistently related to student learning student ability 
and motivation, quantity and quality of instruction, and the qual, 
"ties of the home environment These three sets of factors — the 
student, the school, and the home — are like a three legged stool, 
state Scott and Walberg The stool is only as strong as its weakest 
leg, so strengthening the stronger legs is tar less productive than 
strengthening the weakest " 

Strengthening the strongest leg — the school — is what Ronald 
tdmonds and other researchers would like to do, Scott and V\alberg 
contend In this artic le, they criticize this viewpoint as well as the 
research methodologies used and conclusions drawn by tdmonds 
in three of his publications / 

Some of Edmonds s results coincide with^jtHe conclusions of a 
comprehensive review of the research literature osi the determi- 
nants of academic learning, conducted by Walberg and two col 
leagues Scott and Walberg are skeptical, however, of the conclu- 
sions drawn by Edmonds that do not agree with this review since 
the evidence he assembles is highly limited even in his two lengthy 
papers Moreover, even Edmonds s own dafa demonstrate the 
important influence of background factors on school achievement 

Edmonds asserts that an overemphasis on home influence would 
' not only absolve educators of their responsibility to be instruo 



tionally effective, but (would) place unfairly the burden for learning 
on parents, ' according to Scott and Walberg But emphasizing the 
role of the home in learning should not reduce appreciation of the 
role of the school, these authors state 

After further criticizing bdmonds's methodologies and argu- 
ments, the authors conclude that educators alone are insufficient 
to increase learning productivity dramatically, arid they need the 
cooperation of parents and students themselves " 

Squires, David A. Characteristics of Effective Schools 
The Importance of School Processes Philadelphia 
Research for Better Schools, 1980 44 pages ED 197 
486 

Research on the effectiveness of classroom teaching techniques 
is abundant, but studies ot the influence of the school as a whole on 
student outcomes are few in number 'Vet, what research there is," 
states Squires, indicates that a school's processes, norms and 
values as a social institution do make a significant difference " 
Squires here reviews the best of the school effectiveness studies and 
derives from them numerous questions that, "when answered, 
identify areas where schools are effective and/or where they could 
improve " 

The input output' studies of the sixties attempted to determine 
which inputs" — such as socioeconomic status (SES), availability of 
instructional materials, staff's education and experience, dollars 
spent, and so on— correlated with such outputs as grades, 
achiexement test scores, dropout rates, and so forth The general 
conclusion of these studies was that the most easily measured 
characteristics of school context, with the exception of SES and 
student attitudes, are not associated with student outcomes " 

But what in the school environment, Squires asks, influences 
student attitudes' Several recent studies — including a five-year 
longitudinal study of London schools — support the notion that the 
norms and values of a school, along with certain characteristics of 
schools as social institutions, influence both student attitudes and 
outcomes 

Specifically, such factors as academic emphasis, teacher skills, 
teacher actions in lessons, system of rewards and punishment, pupil 
conditions, responsibility and participation of student*, and staff 
organization were found to be significantly related to student out 
comes Squires concludes by synthesizing a model of school 
processes'' from the research he reviews 
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and determination of professional competence The publication has 
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